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Abstract 

This paper studies multiclass loss systems with two layers of servers, 
where each server at the first layer is dedicated to a certain customer 
class, while the servers at the second layer can handle all customer 
classes. The routing of customers follows an overflow scheme, where ar- 
riving customers are preferentially directed to the first layer. Stochas- 
tic comparison and coupling techniques are developed for studying how 
the system is affected by packing of customers, altered service rates, 
and altered server configurations. This analysis leads to computation- 
ally fast upper and lower bounds for the performance of the system. 
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1 Introduction 

This paper studies multiclass loss systems with two layers of servers, where 
each server at the first layer is dedicated to a certain customer class, and 
the servers at the second layer can handle all customer classes. Arriving 
customers are routed to vacant servers in one of the layers, with preference 
given to the first layer; or rejected otherwise. This policy is commonly 
referred to as overflow routing. 
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Layered networks with overflow routing are commonly used in telecom- 
munications services, because different layers of service may increase the sys- 
tem capacity. In wireless communication networks for instance, the servers 
at the first layer correspond to radio channels dedicated to a small geograph- 
ical area (microcell) , and the second layer represents available radio channels 
in a larger area covering several microcells; in telephone call centers, the first 
layer consists of call agents trained to handling certain types of phone calls, 
and the second layer represents call agents who are cross-trained to deal 
with all types of calls. 

The analysis of multilayer loss systems is challenging even under the sim- 
plest statistical assumptions, because the distributions of the overflow pro- 
cesses from the first layer are complex, and the direct numerical computation 
of the stationary distribution is unfeasible even for relatively small systems 
(Louth, Mitzenmacher, and Kelly [11]). Hence, approximative methods are 
needed for performance analysis (see Kelly [8] for a broad overview). Clas- 
sical approximation techniques such as the equivalent random method and 
the Hayward-Fredericks method [18], and the recently introduced hyperex- 
ponential decomposition (Franx, Koole, and Pot [3]), are based on para- 
metrically modeling the overflow processes from the first layer by simpler 
processes. These methods have been observed to produce good approxima- 
tions for many choices of system parameters. However, they may require 
considerable amounts of computation, and it is not clear whether they re- 
main accurate over the full parameter range. 

The goal of this paper is to approximate the system via upper and lower 
bounds that are easy to compute numerically, and conservative in the sense 
that the true performance remains between the bounds for all choices of 
system parameters. To construct the upper bound, we modify the system 
by redirecting customers from the second layer into the first layer as soon as 
servers become vacant. This so-called maximum packing policy causes the 
number of customers per class to have a product-form stationary distribution 
(Everitt and Macfadyen [2]). The lower bound is constructed by moving all 
servers from the second layer into the first, this way reducing the system 
into a product of independent Erlang loss models. 

The main tools for proving the validity of the bounds are (i) Massey's 
theorem [12] characterizing the comparability of two Markov jump processes; 
and (ii) stochastic coupling, where versions of the processes describing the 
number of customers in the original and the reference system are constructed 
in such a way that the difference of the two processes remains positive with 
probability one. Coupling techniques have been successfully used by several 
authors for deriving stochastic bounds for loss systems: Whitt [1 7] ana- 
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lyzed several single-class queueing systems; Smith and Whitt [15] studied 
the merging of two loss systems together; Nain [14] focused on multiclass 
single-layer loss systems; and Hordijk and Ridder [4] studied a special case 
of the two-layer loss system where the first layer is fully dedicated to a sin- 
gle customer class. This paper extends some of the above results to general 
multiclass two-layer loss systems, the main contribution being in showing 
that maximum packing leads to upper bounds for the time-dependent and 
stationary distributions of the number of customers in the system. In the 
special case where the first layer is fully dedicated to a single customer class, 
this result improves the upper bound obtained by Hordijk and Ridder [4]. 

The paper is organized as follows. Section 2 introduces the model details 
and notation. In Section 3 we prove a preliminary comparison result that is 
key to analyzing the monotonicity of the system. Section 4 analyzes how the 
time-dependent distribution of the system is affected by maximum packing, 
different server configurations, and altered service rates, and in Section 5 
we carry out a similar analysis for the system in steady state. Section 6 
concludes the paper. 

2 Model description 

2.1 Two-layer loss system with overflow routing 

We consider a loss system with K customer classes and two layers of servers, 
where layer 1 contains m k servers dedicated to class h, and layer 2 consists 
of n servers capable of serving all customer classes. Arriving class-/c cus- 
tomers are routed to vacant servers in one of the layers, with preference 
given to layer 1; or rejected otherwise (Figure 1). For analytical tractability, 
we assume that the interarrival times and the service requirements of class-A; 
customers are exponentially distributed with parameters \ k and fi k , respec- 
tively, and that all these random variables across all customer classes are 
independent. For brevity, we denote m = (mi, . . . , mx), A = (Ai, . . . , Xk), 
and fi = (fix, . . .,fi K )- 

Denote by Xj f,(t) the number of class-A: customers being served at layer i 
at time t. The system is described by the continuous-time stochastic process 
X = (Xik) taking values in 

K 

S = {x G x -L% : Xl ,k < m k Vlfe, ^ x 2)k < n}. (1) 

k=l 

Following the usual convention, we assume without loss of generality that 
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Figure 1: Two-layer loss network with three customer classes (K = 3). 

all processes have paths in the space -D(]R + , 5) of right-continuous functions 
with left-hand limits [51. 



Let us denote by en- the unit vector in 



corresponding to the 



coordinate direction (i, k). Moreover, define the sets 
Ai,k = {x G S : xi k < m k }, 



K 



A 2 ,k = {x G S : xi t k = m k , ^x 2 ,i < n}, 

1=1 

K 

B k = {x G 5 : x 1>k = m k , ^ x % i = n}. 



(2) 
(3) 

(4) 



1=1 



The set A^ >k represents the set of states where an arriving class-fe customer 
is assigned to a layer-i server, and B k is the set of states where arriving 
class-A: customers are rejected. The process X is a continuous-time Markov 
process on S with the upward transitions mi| e ik at rate \ jk {x), and 
downward transitions x ^ x — ei :k at rate (f>i )k (x), where 



\ ijk {x) = A fc l(x G A ijk ) 
<t>i,k{x) = VkXi, k - 



(5) 



2.2 Maximum packing 

To approximate the original two-layer loss system, we consider a modifica- 
tion of the system, where customers are redirected from layer 2 to layer 1 
as soon as servers become vacant. This corresponds to the so-called maxi- 
mum packing policy introduced by Everitt and Macfadyen [2]. The process 
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X mp describing the number of customers in this system is a continuous-time 
Markov process on S with the upward transitions x i— > x +ej & at rate A^ 
and downward transitions rr i— > x — e^fc at rate ^(x), where 



A- )fc (x) = Afcl(x G A,fc), « = 1, 2, 
^'l.fc^) = f J 'kXi,kHx 2 ,k = 0), 



(6) 



Remark 1. A remarkable property of the maximum packing policy is that 
all states outside the set S mp = C\^ =1 {x € S : x\^ = mk or x 2 ,k = 0} are 
transient for X mp . Moreover, note that for x 6 S mp , x\ )k = uik if and only 
if x\ k + x 2k > m k, which implies that 



As a consequence, the aggregate process {X™j! + X^)^ =1 tracking the total 
number of customers in each class, if started in S mp , is equal in distribu- 
tion to the Markov process X mp = (X™ p , . . .,X™ P ) on S m P = {x £ Zf : 
Y2k( x k ~~ m k) + < n } generated by the transitions 



The structure of the above transition rates implies that the stationary dis- 
tribution of X mp is a product of Poisson distributions truncated to <S' mp [8], 
which is easy to compute numerically. The stationary distribution of X mp 
can then be recovered from that of X mp using the equalities (7). 

3 Preliminary result 

This section establishes a general result that allows to compare two processes 
taking values in S C x with respect to a specific preorder. This 
preorder, tailored to fit the transition rates of the type in (5), is defined 
by x H y, if x\ jk < yi t k for all k and \x\ < \y\, where \x\ = ^2 ik x ik . For 
random variables with values in S we denote U ^ s t V, if E0(£/j < E</>(V) 
for all bounded measurable functions 4> : S — > K that are increasing with 
respect to the preorder ^ on S. Let us further extend these definitions to 
the Skorohod space D(M.+ ,S) of right-continuous functions with left-hand 
limits by denoting / X g if f(t) H g(t) for all t. For stochastic processes with 



xi,k = (%l,k + X2,k) A m fc , 
%2,k = (xi,k + ^2,fc - rn k )~ 



(7) 




at rate X k l{x + e k e S mp ) 
at rate </>fc(x) = \i k x k . 
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paths in D(R+, S) we denote X X rt Y, if E(f>(X) < E<p(Y) for all bounded 
measurable maps (j) : D(IR+, S) — > R that are increasing with respect to the 
preorder ^ on D(R_|_, S). It will be clear from the context whether ^ refers 
to elements in S or to functions in Z)(R_|_, S). 

Consider a continuous-time Markov process X on S C x Z^; gener- 
ated by the transitions 



x 



x + &i,k at rate \i,k(x), 
x - e i)fc at rate <j>i,k{x), 



2 G {1,2}, A; G where Aj^ and 0^ are bounded nonnegative 

functions on S". For consistency, we assume here that Aj j fc(x) = for all 
x £ S such that x + e^fc ^ 5 and 4>i t k{x) = for all x G S such that 
^ — &i,k £ S. We assume that Y is a similar process with state-dependent 
transition rates A^ k and ^ fe . 

Theorem 1. Let X and Y be Markov processes with paths in D(M> + ,S) 
having upward transition rates Ajfc and X' ik , and downward transition rates 
<t>i^k and k , respectively. Assume that the following two conditions hold: 

(i) For all x,y G S such that x <y and x±f. = yik> 

< Ai )fc (y), (8) 
> cj>' lyk {y). (9) 

(ii) For all x,y G S such that x <y and \x\ = \y\, 

EM^ZXfcfo)' ( 10 ) 

i,k i,k 



TTien X ^ s t Y, given that the initial states satisfy X(0) H Y(0). 

Proof. Denote the infinitesimal generators of X and Y by p and g, respec- 
tively. Recall that U C S is called an upper set, if x G f7 and x <y implies 
y G £7, and V C 5 1 is called a Zower set, if the complement U c of V is an 
upper set. Using a result of Massey [12, Theorem 5.3] 1 (see also [6, Theorem 

1 Massey formulated his result for partially ordered spaces, but all the proofs in his 
paper [12] remain valid also for preorders that are not antisymmetric [9], 



5]), it suffices to verify that p(x, U) < q(y, U) for all x _< y and for all upper 
sets U such that either x E U or y ^ U. Because p(x, U) = —p(x, U c ) for all 
x E U, this condition is equivalent to showing that for all x ■< y, 

A*, fc (x) l(x + e iifc eU)<^2 K,M + G tf) (12) 

for all upper sets ?7 such that x (jz U,y ^ U , and 

<&, fc (x) l(x + ei >fc G > ti,k(y) 1(1/ + e ^ G V) (13) 

for all lower sets V such that x ^ V, y ^ V. 

Assume x <y and choose an upper set U such that x £ U,y £ U ' . To 
verify the validity of (12), let us consider separately the cases \x\ < \y\ and 
\x\ = \y\. Assume first \x\ < \y\. Then x + e\. k ■< y for all k such that 
x i,k < yi,k-> an d x + e2 5 fc ^ V for all /c. Hence because U is an upper set and 
y £ U, it follows that x + ei ; fc E J7 only if x± ik = yi jk , and x + e2,fc ^ ?7 for 
all k. Thus, 

^Mi)l(i + e,, fc ef/)= ^ Ai, fc (z) l(a: + ei )fc € Z7). (14) 

Moreover, using inequality (8), and noting that x + e\ k ^ y + ei & for all Zc 
such that y + e\ jk E 5, we see that for all k such that x\ tk = yi,fc, 

Ai, fe (x) l(x + e ljfc E U) < X 1)k (y) l(y + e ljk E U). (15) 

Substituting (15) into (14) shows the validity of (12). 

Let us next focus on the case |x| = \y\. Note first that if x + e\ t i E U for 
some Z such that x\j < yij, or x+e2j E J7 for some Z, then y + e^fc G Z7 for all 
i and fe. Hence it follows that the right-hand side of (12) equals Yli k K fc(y)> 
which in light of assumption (10) guarantees the validity of (12). On the 
other hand, if x + e2,fc ^ U for all k, and x\^ = yi,k for all k such that 
x + ei^ E U, then equation (14) holds. Assumption (8) again implies (15), 
which together with (14) shows the validity of (12). 

The proof is completed by carrying out an analogous reasoning for lower 
sets, which shows that assumptions (9) and (11) imply (13). □ 

4 Pathwise stochastic comparison 

This section contains the main results for analyzing the time-dependent dis- 
tribution of the system. Assuming first that all service rates across different 



7 



customer classes are equal, we study how the system is affected by maxi- 
mum packing (Section 4.1) and different server configurations (Section 4.2). 
Section 4.3 provides a monotonicity result that allows to extend the analysis 
to the case where the service rates are not assumed equal, and Section 4.4 
describes bounds for the per-class number of customers in the system. 

Recall that the usual stochastic order [13] between real random variables 
is defined by denoting U < s t V, if E/(C/) < E/(V) for all bounded mea- 
surable increasing real functions /. Moreover, for stochastic processes with 
paths in the Skorohod space Z)(R + ,R), we denote X < st Y if Ef(X) < 
E/(Y~) for all bounded measurable functions / : D(R + ,R) — > R that are 
increasing with respect to the natural pointwise order on D(R_|_,R). A cou- 
pling of two stochastic processes X and Y with paths in .D(R+,R) is a 
stochastic process (X, Y) with paths in D(R + ,R 2 ), having X and Y as its 
marginals. Recall that by Strassen's theorem, X < st Y if and only if there 
exists a coupling (X ,Y) of X and Y such that X(t) < Y(t) for all t almost 
surely [6]. Strassen's theorem can further be extended to processes with 
paths in D(R + , S), compared with respect to a given preorder [10]. 

4.1 Maximum packing 

Let X be the process describing the number of customers in the two-layer 
loss system defined in Section 2.1, and denote by X mp the corresponding 
process for the maximum packing policy defined in Section 2.2. Recall from 
Section 3 that the preorder x ^ y is defined by x\k < y± & for all k and 
\x\ < \y\- The following theorem is the main result of the paper. It allows to 
conclude that the stochastic processes t i— > |-X"(t)| and t t— > |X mp (t)| satisfy 
|*| <st |* mp [, given that X{0) * X m P{0). 

Theorem 2. Assume that all service rates fik are equal and that the initial 
states satisfy X(0) r< X m P(0). Then X ^ st X m P. 

Example 1 below shows that a purely deterministic sample path compar- 
ison is not sufficient for proving Theorem 2; hence probabilistic techniques 
are needed. Example 3 in Section 5.2 further shows that the statement of 
Theorem 2 may not be true, if the service rates are not assumed equal. 

Example 1. Consider a two-class system (K = 2) with one server at layer 1 
assigned to class 1 (mi = l,m2 = 0) and one server at layer 2 (n = 1). 
Denote by X = (Xi k) a path of the process tracking the number of customers 
in the original two-layer loss system, and let X mp be a corresponding sample 
path for the maximum packing policy. Assume that during the time interval 
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[0, 6] there are four arriving customers each having service time equal to 
three: three class-1 arrivals at time epochs 0, 2, and 4; and one class-2 arrival 
at time epoch 3. Given that both systems start empty, then X{6) = en 
but X m P(6) = 0. 

Lemma 1. The transition rates \i tk (x) defined in (5) satisfy: 
(i) For all x ^ y and for all k such that x\ k = yik> 

Ai, fe (V) < \ijc(y). (16) 



(ii) For all x ^ y and for all k such that \x\ = \y\, 

i,k i,k 

Proof. The inequality (16) is clear, because Aifc(x) only depends on x\ k . 
Assume next that x < y and \x\ = \y\. Assume that y € B k for some k, 
where B k is defined in (4). Then ^ yn = n, which implies that ^ X21 = n 
and x\ t i = y±j for all I. Thus x £ B k . We may thus conclude that for all k, 
l(x £ B k ) < l(y £ B k ). Hence it follows that 

Kk{x) = x ki{x iB k )<Y x kHy iB k ) = Y Kk(y), 

% , k fc k % j/c 

which shows the validity of (17). □ 

Proof of Theorem 2. Let \i :k {x) and <f>i tk (x) be the transition rates of X as 
defined in (5), and let \' ik {x) and 4>' ik (x) be the corresponding rates for 
X mp as defined in (6). Because A^ k (x) = \i, k (x) for all x, the validity of (8) 
and (10) in Theorem 1 follow by Lemma 1. For the downward transitions, 
note that for all x ■< y such that x\ k = yi.k f° r some k, 4>i tk (x) = HiXi^ k = 
fi>Wi,k > ^iyi,fcl(y 2 ,fc = 0) = 4>' 1)k (y)- Moreover, for all x r< y such that 

\ x \ = \vl 

Y(^M x ) + <hM x )) = m\x\ = m\y\ = Yi^hkiv) + ^2,fe(y))) 

k k 

so conditions (9) and (11) of Theorem 1 are valid. Hence Theorem 1 yields 
the claim. □ 
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4.2 Different server configurations 

This section studies the effect of moving one server from layer 1 to layer 2. 
As in Section 2.1, we denote by X the process describing the number of 
customers in the system with server configuration m = (mi,...,rajf) in 
layer 1, and n servers in layer 2. Let Y by the process corresponding to 
the modified system where one class-A; server from layer 1 has been replaced 
by a server in layer 2. We assume k = 1 without loss of generality. Let 
mf = (mi — 1, 1^2, • • • > fnx) and n' = n + 1, and define the sets S", A! x k and 
B' k as in (l)-(4) with m and n replaced by m! and n', respectively. Then Y 
is a Markov process on S' having transition rates of the form (5) with A^ k 
replaced by A\ k . 

Let us denote by x 2 = Efc x 2,k the number of customers being served 
at layer 2. Assuming that all service rates jjL k are equal, it follows that the 
process (-Xi i, • • • , X^k', X2) is Markov. With a slight abuse of notation, we 
will redefine the state space by S = {(xi t i, ■ ■ ■ , xi^; x 2 ) G ^+ X Z + : ^i,fe < 
m k for all fe,x 2 < n}, and denote by e 2 the unit vector in x Z + corre- 
sponding to the last coordinate. We will redefine the sets Ai k , B k , u,Bi, 

and S' in a similar way, identifying Y2k=i x 2,fc with x 2 - 

Theorem 3. Assume that all service rates are equal, and that the initial 
states satisfy Y (0) — X (0) G A, where A = {0, e<2, &i — e.\\, 2e2 — e^i}. Then 
the stochastic processes 1 1— > |A(i)| and t 1— > satisfy \X\ < s t |Y"|. 

Proof. Because \x\ < \y\ for all x G 5 and y G S" such that y — x £ A, 
it is sufficient to construct a coupling [16] of X and Y that takes values in 
Sa = {(x, y) £ S x S' : y — x G A}. Let (X, Y) be a continuous-time Markov 
process on Sa generated by the joint arrivals 



x,y) h 


-> (x + ei jfc , 2/ + ei jfc ) 


at rate 


A fc l(x G A 1>k , y 




(18) 


x,y) h 


-> (x + ei jfc , y + e 2 ) 


at rate 


A fc l(x G A 1>k , y 




(19) 


x,y) h 


-> (x + ei )fc , y) 


at rate 


A fc l(x g A 1>k , y 




(20) 


x,y) h 


-> (x + e 2 , y + e 2 ) 


at rate 


£,A z l(x G A 2j/ 


- y e ^,), 


(21) 


x,y) h 


-> (x + e 2 , y) 


at rate 


EiAjl(a; G A 2j/ 




(22) 


x,y) h 


-> (x, y + e 2 ) 


at rate 


Ajl(x e flj, 




(23) 
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and joint departures 



(x,y) (-»• (x - e ljk , y- e 1>k ) at rate fJ,\yi,k, (24) 

(x,y) (-»• (x - ei,!, y - e 2 ) at rate Mi(a;i,i - 2/i,i), (25) 

(x, y) (->• (x - e 2 , y - e 2 ) at rate ^ix 2 , (26) 

(x, y) (-»• (x, y - e 2 ) at rate /xi(yi,i + y 2 - zi,i - x 2 ). (27) 

Observe that all transition rates above are nonnegative, because y\ \ < 
Xi,! and y\ t i + y 2 > Xi,! + x 2 , whenever y — x G A. To ensure that the 
transitions define a generator of a Markov process on Sa, we need to verify 
that y' — x' G A for all transitions (x,y) h- > (x',y'), where y — x G A. This 
is obvious for transitions (18), (21), (24), and (26), because in these cases 
y' — x' = y — x. Let us consider the remaining cases one-by-one: 

• If transition (19) occurs, then k = 1, because y\^ = xi,fc for all k ^ 1. 
Then x± \ < mi and j/n = mi — 1, so it follows that either y — x = 
or y — x = e 2 . In both cases, y' — x' G A. 

• If transition (20) occurs, then again fc = 1. Then xi t i < mi and 

= m i — 1) which implies j/i^ = xi^. Moreover, y 2 = n + 1, 
which is only possible if y 2 = x 2 + 1. Hence y — x = e 2 , so that 
y' — x' = e 2 — ei,i G A. 

• If transition (22) occurs, then x G A 2 j and y G B[ for some /. Then 
x 2 < n and y 2 = n + 1, which implies that y — x = 2e 2 — e^i. Hence 
y' — x' = e 2 - ei ; i G A. 

• If transition (23) occurs, then x G Bi and !/ £ A' 2j for some I. Then 
x 2 = n and y 2 < n + 1, so it follows that y 2 = x 2 . Hence y — x = 0, 
and thus y' — x' = e 2 G A. 

• If transition (25) occurs, then yi : i < Xi t \. Because y — x G A, this 
implies that either y — x = e 2 — e^i, so that y' — x' = 0; or y — x = 
2e 2 — e^i, so that y' — x' = e 2 . 

• If transition (27) occurs, then y^i + y 2 — xi^ — x 2 > 0. Because 
y — x G A, it follows that either y — x = e 2 , so that y' — x' = 0; or 
y - x = 2e 2 - ei,!, so y' — x' = e 2 — e^i. 

Hence, all transitions map 5a into 5a, and the process (^,^) is well- 
defined. 

To show that (X, Y) is a coupling of X and Y, we must verify that the 
marginal transition rates of (X, Y) match with the transition rates of X and 
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Y. Note first that the sum of transition rates such that x i— ► x + e\^ is equal 
to A&l(x € A\ fc). Next, observe that x € A 2 j, an d y — x £ A imply that 
y $l A^. Hence the sum of transition rates where x i— ► x + e2 is equal to 

^ A,l(x G A 2 ,j, V G A' 2>1 U 50 = ^2 A;l(x G A 2 ,j). 

Further, because the sum of all transition rates such that x i— > x — e± & equals 
H\x\ t k for all k, and the corresponding sum for x i— > x — e 2 is equal to /iix 2 , 
we may conclude that the transitions of X and X occur at the same rates. 

Turning the attention to the rates of Y, note that y — x £ A and y £ j 
imply that y^i < mi — 1 and x± t i < y± t i + 1, so it follows that x G A^i. 
Moreover, y — x G A and y G fc for ^ 1 imply that xi^ = y\^ < m-h, so 
x £ -*4-i,fc- Hence the total rate of transitions where y \— ► y + is equal to 
Afcl(x G -Ai.fei y € -A'i fc) = Afcl(y G ^4'i fc)- Further, because the net rate of 
transitions where y i— > y + e 2 is equal to ^ A/l(y G A' 2l ), and because the 
corresponding net rates for y i— > y — ei ; fe and y i— ► y — e 2 are equal to fiiyi^ 
and ^iy 2 , respectively, we conclude that the transitions of Y and Y occur 
at the same rates. Hence, the process (X ,Y) is a coupling of X and Y. □ 

4.3 Monotonicity with respect to service rates 

The results in Sections 4.1 and 4.2 were proved under the assumption that 
all service rates are equal. The following theorem describes a monotonicity 
property that allows to compare systems not satisfying this assumption. 
Denote by X the number of customers of the two-layer loss system defined 
in Section 2.1. Recall that the preorder x ■< y is defined by xi^ < y\ t k for 
all k and |x| < |y|. 

Theorem 4. Let X~ and X + be modifications of the system with all service 
rates set to // max = max/ij; and fj, m i n = min/Xfc, respectively. Assume that 
the initial states satisfy X~(0) ^ X(0) ^ X+(0). Then 

X < s t X < st X + . 

Remark 2. A simpler comparison statement, such as \X\ < st \X + \ given 
that |X(0)| < |X + (0)|, is not true in general. Using Massey's [12] criteria 
for the preorder |x| < |y|, it is not hard to check that a necessary condition 
for the above property is that Yli k ^-i,k( x ) = Si k ^i,k(y) whenever |x| = |y|. 
This equality fails for x = ^2 k m^ei^ + (n — l)e 2j i and y = x — e\ t ± + e 2) i- 
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Proof of Theorem 4- Note that X + has the same upward transitions as X 
and downward transitions 4>' lk {x) = /i m in^i,fcj and <j>2k( x ) = A*min^2,fc- Now 
for all x H y such that sci,*. = for some k, fJ, k x 1)k > A*min^l,fe = Mroinyi,fc> 
and for all x ^ y such that |x| = |y|, 

^2vk(xi,k +X 2 ,k) > Mmin ^2(xi,k + X2,k) = Vmm^2(yi,k +2/2,*:), 

so conditions (9) and (11) of Theorem 1 are valid. Moreover, (8) and (10) 
hold by Lemma 1, so Theorem 1 yields the claim for X + . The claim for X~ 
is proved in a similar way. □ 



4.4 Per-class bounds 

In this section, we prove upper and lower bounds for the per-class number 
of customers in the system. Let (t) be the number of customers in 
the standard s-server Erlang loss system at time t, defined as the right- 
continuous Markov process on {0, 1, . . . , s} having the upward transitions 
x i— > x + 1 at rate Xl(x < s) and the downward transitions x i— ► x — 1 at 
rate fix. 

Theorem 5. Assume Z™ k ^ k (0) = X 1>k (0) . Then 

Z™ k M < st X hk + X 2jk . (28) 

Proof. Observe that the process X\ k tracking the number of class-A; cus- 
tomers being served at layer 1 has the same dynamics as a standard m k - 
server Erlang loss system with arrival rate and service rate fi k . Hence 
given Z™* (0) = Xi^O), the processes Z™ k and Xi >k have the same 
distribution, which immediately implies (28). □ 

Theorem 6. Assume X 1 k (0) + X 2 k (0) < Z™ fc + n (0). Then 

X hk + X 2 ,k< st Z2^. (29) 

Proof. Assume without loss of generality that k = 1. Let us construct a 
Markov process (X ,Y) on 

S 2 = {(x, y) 6 S x {0, . . . , mi + n} : a^i + x 2 ,i < y} 
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via the class- 1 transitions for i = 1,2, 

(x, y) i— ► (x + y + 1) at rate Ail(x G Ai t i, y <m\+ n), (30) 

(x, y) i— ► (x + e^i, y) at rate Ail(x 6 Ai : \, y = m\ + n), (31) 

(x,y) i— > (x, y + 1) at rate Ail(x G -Bi, y < mi +n), (32) 

(x,y) h-> (x - e^i, y - 1) at rate mx itl , (33) 

(x,y) (->• (x, y- 1) at rate /ii(y - xi,i - X2,i), (34) 

and the class-A; transitions for k ^ 1 and i = 1,2, 

(x,y) i-> (x + e itk , y) at rate A fc l(x G A i:fe ), (35) 
(x,y) h-> (x - e i)fc , y) at rate Mfc^fc- (36) 

Note that all transition rates in (30) - (36) are nonnegative for all (x, y) G S^- 
Let us now verify that all transitions map £2 into £2- Observe first 
that transition (31) occurs only if y = 7714 + n and either xi 5 i < mi or 
X^jl-Li °°2,k < n, which implies that (x + e^i, y) G S2 for i = 1, 2. Moreover, 
transition (34) occurs only if x^i + X2,i < y, so that (x, y — 1) G £2. Clearly, 
all other transitions map S2 into S*2. Thus the Markov process (X,Y) on 
S*2 is well-defined. 

Moreover, the total rates of transitions in (30) - (36) where x 1— ► x + 
and equal to Afcl(x G >li,fc) and //fcX;^, respectively, for all 

i and A;. The corresponding total rates for y 1— > y + 1 and y 1— ► y — 1 are 
equal to Ail(y < mi + n) and ^iy, respectively. This shows that (X,Y) is 
a coupling of X and so the inequality (29) holds. □ 

Remark 3. The proof of Theorem 5 actually shows that inequality (28) 
can be extended to arbitrary (random or nonrandom) arrival processes and 
service times. Example 2 shows why this kind of purely deterministic sample 
path comparison is not possible for obtaining the result in Theorem 6. 

Example 2. Consider a two-class system [K = 2) with no servers at layer 1 
(mi = 0, 1TI2 = 0) and one server at layer 2 (n = 1). Denote by X = {Xi^) 
a path of the process tracking the number of customers in the original two- 
layer loss system, and let Z be a corresponding sample path of the modified 
(one-class) system that only accepts class- 1 customers. Assume that during 
the time interval [0, 3] there are three arriving customers each having service 
time equal to two: a class-2 arrival at time epoch 0, and two class-1 arrivals 
at time epochs 1 and 2. Given that both systems start empty, then X2,i(3) = 
1 but Z(3) = 0. 
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5 Bounds of the steady-state performance 



Assume from now on that all arrival rates and service rates are strictly 
positive, which implies that all Markov processes treated in the sequel have a 
unique stationary distribution. In this section X = (Xj fc) denotes a random 
vector describing the stationary number of class-fc customers being served 
at layer i in the system, and the quadruple (m, n, A, /i) indicates that a 
performance quantity corresponds to a system with server configuration m = 
(mi, . . . , m,K ) at layer 1, n servers at layer 2, arrival rates A = (Ai, . . . , Xk), 
and service rates fi = (//i, . . . , Hk)- 

5.1 Per-class performance 

Denote by a k = ~Ei(X\ t k + X^ u) the stationary mean number of class-/c 
customers in the system, by 9 k the stationary mean class-A; throughput (the 
number of class-/c customers completing service per unit time), and by b k 
the class-A; blocking probability Note that a k can be viewed as the mean 
class-A; work throughput (amount of class-A; work served per unit time). 
Let Erl(s,p) be a random variable on {0,1,..., s} having distribution 

(X]j=o f]") -1 fr> an< ^ denote its mean by OEri(-s,p), and the probability of 
being equal to s by 6ei-i(s,p)- Note that &Eri(s,p) is equal to the famous 
Erlang B formula. 

Theorem 7. The stationary number of class-k customers in the system 
satisfies 

Erl(m fc , Afc/Vfc) < st X 1>k + X 2 , k <st Erl(m fc + n, \ k /fi k ). (37) 

Especially, the stationary class-k mean number of customers is bounded by 

a Er i(m fc , Afc/jUfc) < a k < a Ev i(m k + n, A fc //x fc ), (38) 

i/ie mean throughput by 

fi k a E Ti(m k , A fe //i fc ) < 6» fc < ^ k a Er \{m k + n, A fe /// fc ), (39) 

and i/ie blocking probability by 

bEri(m k + n, Afc/// fc ) < 6 fc < &Eri(m fc , A fe //x fc ). (40) 

Proof. Let us consider a version of the process X started at X(0) = 0, and 
let be as in Theorem 5 and 2™ fc+n be as i n Theorem 6, both started 
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at zero. Because all these processes are irreducible and positive recurrent, 
and because stochastic ordering is closed with respect to convergence in 
distribution [6], the inequalities (37) follow by taking t — > oo in (28) and (29). 

The inequalities (38) follow by taking expectations, and the bounds (39) 
are a consequence of 9k = f^k^k- In light of the conservation laws Afe(l— bk) = 
8k and A^(l — &Eri) = ^fcOEri) these bounds in turn imply (40). □ 

Figure 2 illustrates the bounds in (37) for a loss network with server 
configuration m = (5, 5) and n = 5, where A = (7.5, 7.5) and [i = (1, 1.3). 




Figure 2: Complementary cumulative distribution functions of the station- 
ary number of class- 1 customers (left) and class-2 customers (right), plotted 
for the original system (solid line) and for the Erlang bounds in (37) (dotted 
lines). 

Remark 4. The Erlang bounds (40) for the blocking probability are well- 
known in the literature (see for example [1]). The stochastic inequalities (37) 
can be viewed as extensions of these classical bounds. 

5.2 Overall performance 

Denote by a = E|X| the stationary mean total number of customers, by 
9 = £\ 9k the stationary mean throughput, and by b the stationary overall 
blocking probability. Note that a may be viewed as the mean work through- 
put (net amount of work served by the system in unit time). We indicate 
by a mp ,# mp ,6 mp the corresponding quantities for a system with maximum 
packing. 

Denote by /i mm and ^i max the vectors where all entries of (i are replaced by 
fi min = min fe [i k and /i max = max fc fj, k , respectively, and let r M = ^ max //U m i n . 
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max 

m'eC m ,n 



Moreover, let us denote by C m ^ n the set of server configurations where all 
layer-2 servers have been replaced by servers in layer 1, so that 

C m ,n = W G ^+ : n^'k — m k and m' k = + n}. 

k k 

Theorem 8. The stationary total number of customers in the system sat- 
isfies 

|X(m',0,A,/i max )| < st |X| < st |X m P(m,n,A,/x min )| (41) 

for all m' € C mj „. Especially, the stationary mean number of customers is 
bounded by 

max o(m', 0, A, /i max ) < a < a mp (m, n, A, /z min ), (42) 

TTl £Cm,n 

the mean throughput by 

r~ l e(m\ 0, A, /i max ) < 6 < r^9 mp {m, n, A, / u min ), (43) 

and the overall blocking probability by 

l-r M (l-6 m P(m,n,A,^ min )) 

<6< min (1-^(1-6^,0^,^))). (44) 

TTl £G m ,n 

Remark 5. In the case where all service rates fi k are equal, the bounds (43) 
and (44) can be written in a more natural form as 

max 9(m', 0, A, fi) < 9 < 6 mp (m,n, A, y), 

b mp (m, n, A, y) < b < min b(mf , 0, A, fi). 

TTl £Crn,n 

Remark 6. The upper and lower bounds in (41), and hence the also the 
bounds in (42) - (44), are easy to compute numerically. The fast com- 
putation of the upper bound is explained in Remark 1. To compute the 
lower bound, observe that \X(m', 0, A, // max )| has the same distribution as 
Erl(m' fc , Afc/^ max ), where the terms in the sum are independent. 

Proof of Theorem 8. Let X be the number of customers in the original sys- 
tem, let W be the number of customers in the system corresponding to the 
parameters (m' , 0, A, /i max ), and let Y be the number of customers in the 
maximum packing system with parameters (m,n, A,/i mm ). Assume that all 
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processes are started at zero initial state. Then Theorem 2 and Theorem 3 
combined with Theorem 4 imply that 

\W(t)\ < st \X{t)\ <st \Y(t)\ (45) 

for all t. Because all of the above processes are irreducible and positive recur- 
rent, and because stochastic ordering is closed with respect to convergence 
in distribution [6], taking t — > oo in (45) shows the validity of (41). The 
bounds in (42) follow by taking expectations, and the bounds in (43) from 
6 = HkCik- These bounds in turn imply (44), because of the conservation 

law(E*A fc )(l-6) = 0. □ 




Figure 3: Stationary mean number of customers for m = (2, 2), n = 2, and 
A = (Anet/2, A ne t/2); where fi = (1,1) on the left, and fj, = (1,1.3) on the 
right; plotted for the original system (solid line) and for the bounds in (42) 
(dotted lines). 

Figure 3 illustrates the bounds (42) of the mean number of customers in 
a two-class system where the net arrival rate A nc t is varying. We see that 
the bounds are rather robust with respect to different values of the arrival 
rates. Figure 4 illustrates the same bounds for varying fj,2, showing that 
the accuracy of the bounds degrades rapidly as the difference of \xi and \i\ 
grows. This loss of accuracy is an inevitable consequence of replacing \i by 
fi mm and /x max in (42). Intuitively one might think that the upper bounds 
in (41) and (42) would hold without replacing ji by /x min . Example 3 shows 
that this is not true in general. However, the right-hand side of (42) with \i in 
place of fi mm , though not generally an upper bound, appears to approximate 
well the original system for a wide range of system parameters, even for the 
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Figure 4: Stationary mean number of customers for m = (2,2), n = 2, 
Hi = 1, and varying ^2, where A = (1, 1) on the left and A = (1,5) on the 
right; plotted for the original system (solid line) and for the bounds in (42) 
(dotted lines). 

extreme choice of service rates of Example 3. The reason is that the actual 
repacking events in the maximum packing system occur relatively rarely in 
moderately loaded systems; see Kelly [7] for an insightful discussion of this 
phenomenon in the context of channel assignment in cellular radio networks. 

Example 3. Consider a two-class loss network with server configuration 
m = (1,0) and n = 2. Assume A = (1,1) and ^ = (gjlO)) so that the 
service rates differ from each other by a factor of 50. Table 1 lists numer- 
ically calculated values of the stationary mean number of customers (per 
class and total) for the original loss network and the modification with max- 
imum packing. The fact a(m,n, X, fj.) > a mp (m, re, A, /i) illustrates that for 
this special choice of parameters, maximum packing does not increase the 
stationary mean number of customers in the system. 





Class 1 


Class 2 


Total 


a(m, n, A, fi) 
a mp (m, re, A, /i) 
a(m, n, A, /i mm ) 
a m P(m,re,A,/x min ) 


2.325657 
2.317818 
1.615744 
1.474617 


0.038612 
0.046344 
0.997537 
1.172442 


2.364269 
2.364162 
2.613281 
2.647059 



Table 1: Mean number of customers in a loss network with and without 
maximum packing. 

Example 4 shows that replacing one layer-2 server by a layer- 1 server 
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may not decrease the stationary mean number of customers, if not all service 
rates fj,^ are equal. This shows that it is necessary to replace \x by / u max in 
order to achieve a lower bound in (41). 

Example 4. Consider a two-class loss network with two different server 
configurations (i) m = (0,0) and n = 3, and (ii) m! = (1,0), n' = 2. 
Assume that A and \i are as in Example 3. Numerically calculated values 
for the stationary mean number of customers (per class and total) given 
in Table 2. The fact a(m,n, A,/i) < a(m',n',\,f/,) illustrates that for this 
special choice of parameters, replacing one layer-2 server by a layer-1 server 
does not decrease the stationary mean number of customers. 





Class 1 


Class 2 


Total 


a(m, 


n,X,fi) 


2.317808 


0.046356 


2.364164 


a(m' 


,n',X,n) 


2.325657 


0.038612 


2.364269 


a(m, 


n, A, /i max ) 


0.099891 


0.099891 


0.199782 


a{m' 


, ri, A, /i max ) 


0.099906 


0.099453 


0.199359 



Table 2: Mean number of customers in a loss network with two different 
server configurations. 



6 Conclusions 

Stochastic comparison techniques were developed for analyzing multiclass 
two-layer loss systems. First, assuming all service rates to be equal, we 
proved that maximum packing stochastically increases the total number of 
customers, and that moving a server from the second layer to the first has 
the opposite effect. The monotonicity of the system with respect to service 
rates was then used to extend the above conclusions to systems where the 
service rates may differ from each other. As a consequence, computationally 
fast upper and lower bounds for the performance of the system were derived. 

The proofs of the main results (excluding Theorem 5) were based on 
coupling of continuous-time Markov processes, for which it was essential to 
assume that the service times are exponentially distributed. On the other 
hand, the stationary distributions of the processes acting as bounds in the 
main results, the maximum packing system and the Erlang loss system, are 
known to be insensitive to the service time distribution [8]. This remark- 
able feature calls for an extension of the comparison results to more general 
service time distributions. This is an important open problem for which we 
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believe that new probabilistic techniques are needed, because a purely de- 
terministic sample path approach was found unsuitable (Examples 1 and 2). 

The accuracy of the bounds was numerically studied for systems with 
small number of servers. The bounds for the per-class quantities appear 
not very accurate in general, though they may still be useful in conservative 
dimensioning of system resources. The bounds for the aggregate system 
quantities are much more accurate, especially when the mean service times 
across different customer classes do not vary too much. For highly variable 
mean service times, the accuracy degrades due to the need to modify the 
service time parameters in Theorem 8; however, if one uses the original \x 
in place of /x min in Theorem 8, the maximum packing system appears to 
approximate well the original system for a wide range of system parameters 
(though not anymore an upper bound in general, see Example 3). The accu- 
rate numerical evaluation of the system becomes difficult when the number 
of servers is large, because of the rapid growth of the state space [11]. An 
interesting future problem is to asymptotically study the sharpness of the 
bounds for large systems using scaling and renormalization techniques. 
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